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MINIMALIST COLOR SPACE CONVERTERS FOR OPTIMIZING IMAGE 



BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] Embodiments of the present invention generally relate to a method and 
apparatus for performing color space conversions, and more particularly between 
the red, green and blue (RGB) color space and the luminance color, blue color 
difference and red color difference (YCbCr) color space. 

Description of the Related Art 

[0002] The RGB color space is a digital format widely used in computer graphics 
and imaging. Red, green and blue are the primary additive colors. Components of 
these primary colors can be combined to form any desired color. The RGB color 
space is the most prevalent choice for computer graphics frame buffers (the memory 
used to hold images for display) because computer monitors use red, green and 
blue phosphors to create the desired color. Consequently, using the RGB color 
space simplifies the architecture and design of the system. 

[0003] However, certain operations on the pixel data are better performed in 
another color space, such as the YCbCr color space. Accordingly, a color space 
conversion may need to be performed to convert the pixel data from the RGB color 
space to another color space, such as the YCbCr color space. 

[0004] ITU-R BT.601 establishes the following formulas for converting from the 
RGB color space to the YCbCr color space: 



[0005] Color space conversion is often implemented by employing multipliers or 

look-up tables to achieve the multiplication operations, and by combining the 
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Y = 0.299R + 0.587G + 0.1 14B 



Cb = 0.564(B-Y) 
Cr = 0.713(R-Y) 



(1) 
(2) 
(3) 
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resultant component products to complete the conversion. The multiplication 
operations dominate the operating efficiency and the hardware complexity of a color 
space converting apparatus. Therefore, the number of multiplication operations is 
crucial. A 3-by-3 multiplication is typically used for converting between any two color 
spaces of three color components. Although such a multiplication offers flexibility, it 
is relatively expensive to implement. 

[0006] To perform the RGB to YCbCr color space conversion of equations (1 ) to 
(3), a conventional color space converter needs to first perform three multiplication 
operations to obtain the Y color signal, and then derive the (B-Y) and (R-Y) color 
difference signals before performing two more multiplication operations to obtain the 
Cb and Cr color signals, respectively. Although the color space converter requires 
only five multiplication operations that involve relatively simple hardware, the 
operating efficiency of the color space converter is relatively poor since the 
multiplication operations are done in two operating stages. 

[0007] Equations (2) and (3) can be expanded so that the Cb and Cr color 
signals are entirely in terms of the R, G and B color signals: 

Cb = -0.1 69R - 0.331 G + 0.5B (4) 

Cr = 0.5R - 0.419G- 0.081 B (5) 

As such, implementation of equations (1), (4) and (5) requires nine multiplication 
operations, which makes the color space conversion still a relatively expensive 
computational process. 

[0008] Therefore, a need exists in the art for a more cost effective method for 
performing color space conversion between the RGB color space and the YCbCr 
color space. 
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SUMMARY OF THE INVENTION 

[0009] One objective of various embodiments of the invention is to enable certain 
operations to be performed on the pixel data in one color space while operating 
within another color space. 

[0010] Another objective of various embodiments of the invention is to provide an 
alternative color space out of the necessity to make pixel processing as simple as 
possible, while avoiding the cost of using standard color space converters. 

[0011] Another objective of various embodiments of the invention is to provide an 
alternative color space that is close enough to the standard color space such that 
the visual difference from the human eye's perspective is negligible. 

[0012] Various embodiments of the present invention are generally directed to a 
graphics processing unit, which includes a memory for storing pixel data in a red, 
green and blue (RGB) color space and a display pipeline. The display pipeline 
includes an RGB color space to a luminance color, blue color difference and red 
color difference (YCbCr) color space converter module configured to convert the 
pixel data from the RGB color space to the YCbCr color space. The RGB to YCbCr 
color space converter module generates a luminance color component (Y) of the 
pixel data by adding % of a red color (R) component of the pixel data to V2 of a green 
color (G) component of the pixel data and V* of a blue color (B) component of the 
pixel data. The luminance color component (Y) of the pixel data may be determined 
by left shifting the green color (G) component of the pixel data by one bit, adding the 
result to the red color (R) component of the pixel data and the blue color (B) 
component of the pixel data, and right shifting the sum by two bits. 

[0013] In one embodiment, the RGB to YCbCr color space converter module 
determines a blue color difference component (Cb) of the pixel data by subtracting 
the luminance color component (Y) of the pixel data from the blue color (B) 
component, and dividing the result by two. The blue color difference component 
(Cb) of the pixel data may be determined by subtracting the luminance color 
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component (Y) of the pixel data from the blue color (B) component of the pixel data, 
and right shifting the sum by one bit. 

[0014] In another embodiment, the RGB to YCbCr color space converter module 
determines a red color difference component (Cr) of the pixel data by subtracting the 
luminance color component (Y) of the pixel data from the red color (R) component of 
the pixel data; and dividing the result by two. The red color difference component 
(Cr) of the pixel data may be determined by subtracting the luminance color 
component (Y) of the pixel data from the red color (R) component of the pixel data; 
and right shifting the result by one bit. 

[0015] In yet another embodiment, the display pipeline further comprises a 
YCbCr to RGB color space converter module configured to convert the pixel data 
from the YCbCr color space to the RGB color space. The YCbCr to RGB color 
space converter module generates the red color (R) component of the pixel data by 
adding the luminance color component (Y) to twice the red color difference 
component (Cr) of the pixel data. The red color (R) component of the pixel data may 
be determined by left shifting the red color difference component (Cr) of the pixel 
data by one bit, and adding the result to the luminance color component (Y) of the 
pixel data. 

[0016] In still another embodiment, the YCbCr to RGB color space converter 
module further generates the green color (G) component of the pixel data by 
subtracting the red color difference component (Cr) and the blue color difference 
component (Cb) of the pixel data from the luminance color component (Y) of the 
pixel data. 

[0017] In still yet another embodiment, the YCbCr to RGB color space converter 
module further generates the blue color (B) component of the pixel data by adding 
the luminance color component (Y) of the pixel data to twice the blue color 
difference component (Cb) of the pixel data. The blue color (B) component of the 
pixel data may be determined by left shifting the blue color difference (Cr) 



5 



PATENT 

Attorney Docket No.: NVDA/P000715 
Express Mail No.: EV335477765US 

component of the pixel data by one bit, and adding the result to the luminance color 
component (Y) of the pixel data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0018] So that the manner in which the above recited features of the present 
invention can be understood in detail, a more particular description of the invention, 
briefly summarized above, may be had by reference to embodiments, some of which 
are illustrated in the appended drawings. It is to be noted, however, that the 
appended drawings illustrate only typical embodiments of this invention and are 
therefore not to be considered limiting of its scope, for the invention may admit to 
other equally effective embodiments. 

[0019] Figure 1 illustrates a simplified block diagram of a computer system 
according to an embodiment of the present invention. 

[0020] Figure 2 is a flow diagram of a method for converting pixel data from an 
RGB space to a YCbCr space in accordance with one embodiment of the invention. 

[0021] Figure 3A illustrates a logic diagram for determining the luminance color 
component (Y) of the pixel data in accordance with one embodiment of the 
invention. 

[0022] Figure 3B illustrates a logic diagram for determining the blue color 
difference component (Cb) of the pixel data in accordance with one embodiment of 
the invention. 

[0023] Figure 3C illustrates a logic diagram for determining the red color 
difference component (Cr) of the pixel data in accordance with one embodiment of 
the invention. 

[0024] Figure 4 illustrates a flow diagram of a method for converting pixel data 
from the YCbCr space to the RGB space in accordance with one embodiment of the 
invention. 
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[0025] Figure 5A illustrates a logic diagram for determining the red color 
component (R) of the pixel data in accordance with one embodiment of the 
invention. 

[0026] Figure 5B illustrates a logic diagram for determining the green color 
component (G) of the pixel data in accordance with one embodiment of the 
invention. 

[0027] Figure 5C illustrates a logic diagram for determining the blue color 
component (B) of the pixel data in accordance with one embodiment of the 
invention. 

DETAILED DESCRIPTION 

[0028] Figure 1 illustrates a simplified block diagram of a computer system 100 
according to an embodiment of the present invention. The computer system 100 
includes a central processing unit (CPU) 102 and a system (main) memory 104 
communicating via a system bus 106. User input is received from one or more user 
input devices 108 (e.g., keyboard, mouse) coupled to the system bus 106. Visual 
output is provided on a pixel based display device 110 (e.g., a conventional CRT, TV 
or LCD based monitor, projector, etc.) operating under control of a graphics 
processing unit (GPU) 112 coupled to the bus 106. Other components, such as one 
or more storage devices 128 (e.g., a fixed or removable magnetic disk drive, 
compact disk (CD) drive, and/or DVD drive), may also be coupled to the system bus 
106. In one embodiment, the computer system 100 operates in a red, green and 
blue (RGB) color space. Although various embodiments of the invention are 
described herein with reference to the computer system 100 operating in the RGB 
color space, the invention contemplates the computer system 100 operating in other 
color spaces, such as YCbCr. 

[0029] The system memory 104 stores various programs or applications, such as 
operating system programs for generating the pixel data to be processed by the 
GPU 112. Examples of operating system programs 130 include Graphical Device 
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Interface (GDI) component of the Microsoft Windows operating system. The system 
memory 104 may further store a graphics driver program for enabling 
communication with the GPU 112. The graphics driver program may implement one 
or more standard application program interfaces (APIs), such as Open GL and 
Microsoft DirectX, for communication with the GPU 112. By invoking appropriate 
API function calls, the operating system programs are able to instruct the graphics 
driver program to transfer the pixel data to the GPU 1 12 via the system bus 106 and 
invoke various rendering functions of the GPU 112. Such pixel data are typically 
stored and represented in binary form. Data transfer operations may be performed 
using conventional DMA (direct memory access) or other operations. In one 
embodiment, the system memory 104 may store pixel data in the RGB color space. 

[0030] The computer system 100 further includes a local memory or frame buffer 
1 14 in communication with the GPU 112. The frame buffer 1 14 stores the pixel data 
to be read by a scanout control logic and transmitted to the display device 110 for 
display as an image. In one embodiment, the frame buffer 114 stores the pixel data 
in the RGB color space. Although the frame buffer 114 is shown as distinct and 
apart from the system memory 104, in some implementations, such as in a Unified 
Memory Architecture, the frame buffer 114 and the system memory 104 would 
share the same physical memory devices. 

[0031] The GPU 112 includes various components for receiving and processing 
graphics system commands received via the bus 106. The GPU 112 includes a 
memory management unit 120 and a display pipeline 130. The memory 
management unit 120 reads the pixel data from the frame buffer 1 14 or the memory 
104, places the pixel data in order and transmits the pixel data to the display pipeline 
130 for processing. 

[0032] The display pipeline 130 is generally used for image processing. The 
display pipeline 130 may contain various processing modules configured to convert 
the pixel data into pixel data suitable for displaying on the display device. In an 
embodiment in which the computer system 100 operates in the RGB color space, 
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the display pipeline 130 may include a module 142 that processes the pixel data in 
the red green blue (RGB) color space. Examples of processing modules that 
operate in the RGB color space include brightness control, contrast control and 
gamma correction. 

[0033] In one embodiment, the display pipeline 130 further includes an RGB to 
YCbCr color space converter module 144, which is configured to convert the pixel 
data from the RGB color space to the YCbCr space. A detailed description of the 
operations of the RGB to YCbCr color space converter module 144 is provided in 
the paragraphs below with reference to Figures 2-3. 

[0034] Once the pixel data have been converted to the YCbCr space, the pixel 
data may be processed in the YCbCr space. Accordingly, the display pipeline 130 
may further include a module 146 for processing the pixel data in the YCbCr color 
space. Examples of processing modules that operate in the YCbCr color space 
include color hue or saturation control. 

[0035] In accordance with one embodiment of the invention, the display pipeline 
130 further includes a YCbCr to RGB color space converter module 148, which is 
configured to convert the pixel data from the YCbCr space to the RGB space. In this 
manner, the pixel data may be converted back to the RGB space once the 
processing of the pixel data in the YCbCr space is completed. A detailed description 
of the operations of the YCbCr to RGB color space converter module 148 is 
provided in the paragraphs below with reference to Figures 4-5. 

[0036] Although the display pipeline 130 has been described with reference to 
include one RGB to YCbCr color space converter module 144 followed by one 
YCbCr to RGB color space converter module 148, various embodiments of the 
invention contemplate the display pipeline 130 having one YCbCr to RGB color 
space converter module 148 followed by one RGB to YCbCr color space converter 
module 144. Various embodiments of the invention also contemplate the display 
pipeline 130 having any number of RGB to YCbCr color space converter modules 
144 and any number of YCbCr to RGB color space converter modules 148. 

9 
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[0037] In an embodiment in which the pixel data is displayed on a television 
screen, the display pipeline 130 further includes an industry standard RGB to YCbCr 
color space converter module 150 to convert the pixel data to the YCbCr space. 
The industry standard RGB to YCbCr color space converter module 150 operates in 
connection with a digital to analog converter 162 to display the pixel data on the 
television screen. 

[0038] In an embodiment in which the pixel data is displayed on a CRT, the 
display pipeline 130 further includes a digital to analog converter 161 to convert the 
pixel data from digital to analog prior to being displayed on the CRT. 

[0039] It will be appreciated that the computer system 100 is illustrative and that 
variations and modifications are possible. The computer system 100 may be a 
desktop computer, server, laptop computer, palm-sized computer, tablet computer, 
game console, set-top box, personal digital appliance, tethered Internet appliance, 
portable gaming system, cellular/mobile telephone, computer based simulator, or the 
like. The display device 110 can be any pixel-based display, e.g., a CRT or LCD 
monitor, projector, printer, etc. In some instances, multiple display devices (e.g., an 
array of projectors or CRT monitors) may be supported, with each device displaying 
a portion of the image data. The GPU 112 or any of its components may be 
implemented using one or more programmable processors programmed with 
appropriate software, application specific integrated circuits (ASICs), other 
integrated circuit technologies, or any combination of these. In view of the present 
disclosure, persons of ordinary skill in the art will recognize that the present 
invention can be embodied in a wide variety of system configurations. 

[0040] Figure 2 is a flow diagram of a method 200 for converting pixel data from 
an RGB space to a YCbCr space in accordance with one embodiment of the 
invention. At step 210, a luminance color component (Y) of the pixel data is 
determined using the equation Y = R/4 + G/2 + B/4, where R is the red color 
component of the pixel data, where G is the green color component of the pixel data, 
where B is the blue color component of the pixel data. Notably, the color space 
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coefficients used to determine the luminance color component (Y) in step 210 are in 
a binary form. Accordingly, the luminance color component (Y) may be calculated 
using binary arithmetic and avoid the use of multiplication, which allows the 
luminance color component (Y) to be determined in a relatively inexpensive manner. 

[0041] In accordance with one embodiment of the invention, the luminance color 
component (Y) of the pixel data may be determined according to a logic diagram 
310 illustrated in Figure 3A. As such, the luminance color component (Y) of the 
pixel data is determined by left shifting the green color component by one bit (which 
is equivalent to a multiplication by two), adding the result to the red color component 
and the blue color component, and right shifting the entire sum by two bits (which is 
equivalent to a division by four). In one embodiment, the logical diagram 310 may 
be refined by performing a numerical rounding operation prior to right shifting the 
entire sum by two bits. Numerical rounding is typically used to improve the accuracy 
of a result and prevents cumulative errors. The numerical rounding may be 
performed using conventional techniques, such as adding a value equal to 2 raised 
to the power of the number of shifted bits minus 1 (i.e., 2 (s " 1) , where s is the number 
of shifts) to the entire sum prior to right shifting the entire sum. Left shifting and right 
shifting operations are free to implement from a cost and computational resource 
perspectives. Accordingly, the luminance color component (Y) of the pixel data may 
be determined in a relatively inexpensive manner using the left and right shifting 
operations described in logic diagram 310. 

[0042] At step 220, a blue color difference component (Cb) of the pixel data is 
determined using the equation Cb = (B-Y)/2, where B is the blue color component of 
the pixel data and Y is the luminance color component (Y) of the pixel data 
determined at step 210. As in step 210, the color space coefficients used to 
determine the blue color difference component (Cb) of the pixel data are also in a 
binary form. Accordingly, the blue color difference component (Cb) of the pixel data 
may be calculated using binary arithmetic and avoid the use of multiplication, which 
allows the blue color difference component (Cb) of the pixel data to be determined in 
a relatively inexpensive manner. 
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[0043] In accordance with one embodiment of the invention, the blue color 
difference component (Cb) of the pixel data may be determined according to a logic 
diagram 320 illustrated in Figure 3B. As such, the blue color difference component 
(Cb) of the pixel data is determined by subtracting the luminance color component 
(Y) of the pixel data determined at step 210 from the blue color component of the 
pixel data and right shifting the sum by one bit (which is equivalent to a division by 
two). In one embodiment, a numerical rounding operation may be performed prior to 
right shifting the sum by one bit. As mentioned above, since right shifting operations 
are free to implement, the blue color difference component (Cb) of the pixel data 
may be determined in a relatively inexpensive manner using the right shifting 
operation described in logic diagram 320. 

[0044] At step 230, a red color difference component (Cr) of the pixel data is 
determined using the equation Cr = (R-Y)/2, where R is the red color component of 
the pixel data and Y is the luminance color component of the pixel data determined 
at step 210. As in steps 210 and 220, the color space coefficients used to determine 
the red color difference component (Cr) of the pixel data are also in a binary form. 
Accordingly, the red color difference component (Cr) of the pixel data may be 
calculated using binary arithmetic and avoid the use of multiplication, which allows 
the red color difference component (Cr) of the pixel data to be determined in a 
relatively inexpensive manner. 

[0045] In accordance with one embodiment of the invention, the red color 
difference component (Cr) of the pixel data may be determined according to a logic 
diagram 330 illustrated in Figure 3C. Referring to Figure 3C, the red color difference 
component (Cr) of the pixel data is determined by subtracting the luminance color 
component (Y) of the pixel data from the red color component of the pixel data and 
right shifting the result by one bit (which is equivalent to a division by two). In one 
embodiment, a numerical rounding operation may be performed prior to right shifting 
the result by one bit. As mentioned above, since right shifting operations are free to 
implement, the red color difference component (Cr) of the pixel data may be 
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determined in a relatively inexpensive manner using the right shifting operation 
described in logic diagram 330. 

[0046] Figure 4 illustrates a flow diagram of a method 400 for converting pixel 
data from the YCbCr space to the RGB space in accordance with one embodiment 
of the invention. At step 410, a red color component (R) of the pixel data is 
determined using the equation R = Y + 2Cr, where Y is the luminance color 
component of the pixel data and Cr is the red color difference component of the pixel 
data. As in the steps described with reference to Figure 2, the color space 
coefficients used to determine the red color component (R) of the pixel data are also 
in a binary form. Accordingly, the red color component (R) of the pixel data may be 
calculated using binary arithmetic and avoid the use of multiplication, which allows 
the red color component (R) of the pixel data to be determined in a relatively 
inexpensive manner. 

[0047] In accordance with one embodiment of the invention, the red color 
component (R) of the pixel data may be determined according to a logic diagram 
510 illustrated in Figure 5A. Referring now to Figure 5A, the red color component 
(R) of the pixel data is determined by left shifting the red color difference component 
(Cr) of the pixel data by one bit (which is equivalent to a multiplication by two) and 
adding the result to the luminance color component (Y) of the pixel data. As 
mentioned above, since left shifting operations are free to implement, the red color 
component (R) of the pixel data may be determined in a relatively inexpensive 
manner using the left shifting operation described in logic diagram 510. 

[0048] At step 420, a green color component (G) of the pixel data is determined 
using the equation G = Y - Cb - Cr, where Y is the luminance color component of 
the pixel data, Cb is the blue color difference component of the pixel data and Cr is 
the red color difference component of the pixel data. As in step 410, the color space 
coefficients used to determine the green color component (G) of the pixel data are 
also in a binary form. Accordingly, the green color component (G) of the pixel data 
may be calculated using binary arithmetic and avoid the use of multiplication, which 
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allows the green color component (G) of the pixel data to be determined in a 
relatively inexpensive manner. 

[0049] In accordance with one embodiment of the invention, the green color 
component (G) of the pixel data may be determined according to a logic diagram 
520 illustrated in Figure 5B. Referring now to Figure 5B, the green color component 
(G) of the pixel data is determined by subtracting the blue color difference 
component (Cb) of the pixel data from the luminance color component Y of the pixel 
data and further subtracting the red color difference component Cr from the result. 

[0050] At step 430, a blue color component (B) of the pixel data is determined 
using the equation B = Y + 2Cb, where Y is the luminance color component of the 
pixel data and Cb is the blue color difference component of the pixel data. As in 
steps 410 and 420, the color space coefficients used to determine the blue color 
component (B) of the pixel data are also in a binary form. Accordingly, the blue 
color component (B) of the pixel data may be calculated using binary arithmetic and 
avoid the use of multiplication, which allows the blue color component (B) of the 
pixel data to be determined in a relatively inexpensive manner. 

[0051] In accordance with one embodiment of the invention, the blue color 
component (B) of the pixel data may be determined according to a logic diagram 
530 illustrated in Figure 5C. Referring now to Figure 5C, the blue color component 
(B) of the pixel data is determined by left shifting the blue color difference 
component Cr of the pixel data by one bit (which is equivalent to a multiplication by 
two) and adding the result to the luminance color component Y of the pixel data. As 
mentioned above, since left shifting operations are free to implement, the blue color 
component (B) of the pixel data may be determined in a relatively inexpensive 
manner using the left shifting operation described in logic diagram 530. 

[0052] While the foregoing is directed to embodiments of the present invention, 
other and further embodiments of the invention may be devised without departing 
from the basic scope thereof, and the scope thereof is determined by the claims that 
follow. 
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